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SYSTEM AND METHOD FOR PROVIDING ROTATIONAL 
HAPTIC FEEDBACK 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application claims priority to U.S. Provisional Application No. 
60/419,984 filed October 20, 2002, the entire disclosure of which is incorporated herein 
by reference. 

NOTICE OF COPYRIGHT PROTECTION 
[0002] A portion of the disclosure of this patent document and its figures contain 
material subject to copyright protection. The copyright owner has no objection to the 
facsimile reproduction by anyone of the patent document, but otherwise reserves all 
copyrights whatsoever. 

FIELD OF THE INVENTION 
[0003] The present invention generally relates to providing haptic feedback to user 
interface devices. The present invention more particularly relates to providing haptic 
feedback for a rotational touchpad. 

BACKGROUND 

[0004] Designers and manufacturers of hand-held devices, such as personal digital 
assistants, cell phones, and MP3 players are constantly striving to improve the interfaces 
of these devices. One relatively recent innovation has been the introduction of the 
touchpad. The touchpad has become a common feature of conventional laptops and has 
begun to appear in hand-held devices as well. 
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[0005] One such hand-held device is a personal MP3 player. Conventional MP3 
players and other such devices include a circular touchpad, which is used to navigate 
menus, lists, and other user interface elements. The user interfaces may also include 
various other elements, including conventional buttons. 

SUMMARY 

[0006] Embodiments of the present invention provide systems and methods for 
providing rotational haptic feedback. One embodiment provides haptic cues to a touch- 
sensitive input device having a rotary degree of freedom. One such embodiment 
comprises a touch sensitive input device is configured to move in a rotary degree of 
freedom, and an actuator configured to produce a rotational force on the touch-sensitive 
input device. 

[0007] In one embodiment, the actuator comprises an electromagnetic core 
configured to produce force on a magnet affixed to the touch-sensitive input device. In 
other embodiments, a motor provides the rotational force. For example, in one 
embodiment, the motor drives a belt. The belt is configured to rotate the touch-sensitive 
input device. In another embodiment, the motor drives a flexure, which is configured to 
rotate the touch-sensitive input device. 

[0008] Further details and advantages of embodiments of the present invention are set 
forth below. 

BRIEF DESCRIPTION OF THE FIGURES 
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[0009] These and other features, aspects, and advantages of the present invention are 
better understood when the following Detailed Description is read with reference to the 
accompanying drawings, wherein: 

Figure 1 A is an MP3 device utilizing one embodiment of the present 

invention; 

Figure IB is an exploded view of a user interface according to one 
embodiment of the present invention; 

Figure 2 is a non-exploded, bottom view of the user interface shown in Figure 

IB in one embodiment of the present invention; 

Figure 3 is a cross sectional view of the user interface depicted in Figures IB 
and 2 in one embodiment of the present invention; 

Figure 4 is a top view of the user interface shown in Figures 1-3 in one 
embodiment of the present invention; 

Figure 5 is a top view of one alternate embodiment of the present invention; 

Figure 6 is a top view of an embodiment of the present invention utilizing a 

belt drive actuator; 

Figure 7 is a side view of the embodiment shown in Figure 6; 

Figure 8 is a top view of an embodiment of the present invention utilizing a 
flexure actuator; 

Figures 9A and 9B are block diagram, illustrating communications occurring 
between various elements in embodiments of the present invention; 

Figures 9C and 9D are timing diagrams, illustrating two methods of passing 
signals between the elements shown in Figure 9A in embodiments of the present 
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invention; 

Figure 10 is a flowchart, illustrating a flow of information between various 
modules of the firmware in one embodiment of the present invention; and 

Figures 1 1 A and 1 IB illustrate an embodiment of a process for interpreting 
list and haptic cue parameters according to the present invention. 

DETAILED DESCRIPTION 
[0010] Embodiments of the present invention include systems and methods for 
providing rotational haptic feedback. One embodiment includes a circular touchpad 
activated by a moving magnet actuator. Other embodiments include small motors 
attached to a user interface element to provide a rotational vibrotactile sensation. These 
and other embodiments are described below. 

[0011] Referring now to the drawings, in which like numerals indicate like elements 
throughout the several figures, Figure 1 A illustrates an MP3 player. The personal MP3 
player includes a touch-sensitive input device, touchpad 102. Touchpad 102 senses the 
position of a conductor, such as a finger, on the surface of the touchpad. The touchpad is 
further able to provide a position, comprising X and Y parameters, as well as a pressure, 
Z parameter, as an output signal. The touchpad 102 shown in Figure 1 utilizes 
capacitance, however, an embodiment of the present invention may be implemented in 
conjunction with any touch-sensitive input device, including resistive and membrane- 
switch touch-sensitive input devices. 

[0012] Capacitance-based touchpads are well known to those skilled in the art, and 
therefore, only a basic description of their function is provided herein. A capacitance 
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touchpad, such as touchpad 102 shown in Figure 1, includes two sets of wires, which are 
perpendicular to one another and configured so that a gap is formed between them. 
When a user places a conductor, such as a finger, on the touchpad 102, wires of the two 
perpendicular sets are brought together and form a capacitance. The touchpad 102 
measures which of the wires in each of the two sets has the most capacitance to determine 
where the conductor is touching the touchpad 102 and, based on this information, 
provides the X and Y coordinates of the position of the conductor on the touchpad 102. 

[001 3] The touchpad 1 02 also provides a pseudo pressure, Z. The pseudo pressure is 
based on the amount of capacitance resulting from the conductor touching the touchpad 
102. Accordingly, the amount of capacitance is not a direct measure of pressure but 
rather a pseudo pressure. 

[001 4] The personal MP3 player shown in Figure 1 also includes an LCD display 
120. In Figure 1 A, the LCD 120 is displaying a menu. A user uses the touchpad 102 to 
navigate the menu. When the user moves a finger in a counterclockwise direction on the 
touchpad 102, signals are sent by the touchpad 102 to a processor (not shown). Program 
code executing on the processor interprets the signals as a command to move down 
through the list of items in the menu. 

[0015J The processor executes computer-executable program instructions stored in 
memory. Such processors may include a microprocessor, an ASIC, and state machines. 
Such processors include, or may be in communication with, media, for example 
computer-readable media, which stores instructions that, when executed by the processor, 
cause the processor to perform the steps described herein. Embodiments of computer- 
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readable media include, but are not limited to, an electronic, optical, magnetic, or other 
storage or transmission device capable of providing a processor, such as the processor 
110 of client 102a, with computer-readable instructions. Other examples of suitable 
media include, but are not limited to, a floppy disk, CD-ROM, DVD, magnetic disk, 
memory chip, ROM, RAM, an ASIC, a configured processor, all optical media, all 
magnetic tape or other magnetic media, or any other medium from which a computer 
processor can read instructions. Also, various other forms of computer-readable media 
may transmit or carry instructions to a computer, including a router, private or public 
network, or other transmission device or channel, both wired and wireless. The 
instructions may comprise code from any computer-programming language, including, 
for example, C, C++, C#, Visual Basic, Java, Python, and JavaScript. 

[0016] Referring still to Figure 1 A, when the processor executes the commands to 
redraw the display 120, the processor also sends a signal to a second processor or a 
second program. The signal includes information necessary to create a haptic cue. The 
second processor computes the waveform necessary to create the cue and sends signals to 
an actuator. The actuator executes the waveform, causing the touchpad to rotate slightly 
back and forth. The user senses a vibrotactile effect that approximates a detent. Other 
cues, responses, vibrotactile effects, and other features may be provided. 

[0017] An embodiment of the present invention may utilize any type of touch- 
sensitive input device, such as the touchpad 102 described above, a touch panel, or other 
device. The input device may be of any shape, including round and rectangular shapes. 
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The input device is configured to move in a rotary degree of freedom. An actuator is 
figured to produce a rotational force on the touch-sensitive input device. 



con 



[0018] In one embodiment of the present invention, the range of motion in the rotary 
degree of freedom is limited. To achieve the limitation, either the motor or the input 
device comprises means for limiting motion in the rotary degree of freedom. For 
example, in one embodiment, the motor comprises two rubber end stops at each limit of 
rotation. In another embodiment, the touch-sensitive input device includes end stops to 
limit its range of motion. 

[0019] Various types of actuators may be utilized in an embodiment of the present 
invention. For example, in one embodiment, the touch-sensitive input device comprises 
one or more magnets and the actuator comprises a magnetic core, such as an E-core. 
When the magnetic core is energized, the core produces a rotational force on the input 
device. 

[0020] In another embodiment, a motor provides the rotational force. In one such 
embodiment, the motor drives a belt, which is configured to produce the rotational force 
directly or indirectly on the input device. In another embodiment, the motor is connected 
to a flexure, such as a brass flexure, which produces rotational force on the input device. 

[0021] In one embodiment of the present invention, the freedom of movement of the 
touch-sensitive input device serves to increase the effectiveness of a vibration imparted 
on the input device. By isolating the input device from the housing or other ground, the 
input device is able to move more freely in the rotary degree of freedom when vibrated. 
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In one such embodiment, the actuator comprises an eccentric rotating mass mounted on a 
motor. 

[0022] An embodiment of the present invention may perform various methods. For 
example, in one embodiment, the processor receives an input signal and, in response, 
generates an output signal configured to cause an actuator to produce a rotational force on 
the touch-sensitive input device. In one such embodiment, the output signal is configured 
to impart a "pop" sensation on the input device. 

[0023] Figure IB is an exploded view of one embodiment of a user interface 
according to the present invention. The user interface 100 shown may be used an any 
one of a variety of devices, including, for example, personal digital assistants, cell 
phones, and MP3 players. 

[0024] Referring again to Figure IB, the user interface 100 shown includes a circular 
touchpad 102. The touchpad comprises a user interface device often used in place of a 
mouse or other similar pointing device. One embodiment of a touchpad provides a 
surface upon which a user slides a finger or other pointing device. Embodiments of 
touchpads include those that contain a two-layer grid of electrodes connected to an 
integrated circuit, and rely on coupling capacitance. The upper layer of the grid contains 
vertical electrode strips and the bottom layer contains horizontal electrode strips. The 
integrated circuit measures capacitance at the intersections of the horizontal and vertical 
strips. Movement of the user's finger across the touchpad causes changes in the 
capacitance. A processor interprets the change in capacitance as a particular user input. 
The embodiment shown includes a circular touchpad. Touchpads, buttons, and other 
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interface elements of both circles and other shapes may be used in embodiments of the 
present invention. 

[0025] In the embodiment shown in Figure 1 B, the touchpad 1 02 provides a one- 
dimensional, single axis of movement. Movement around the touchpad causes a change 
in the list position or to other interface parameters. For example, in one embodiment, if 
the user moves a finger counterclockwise on the touchpad 102, a controller (not shown) 
associated with the touchpad 102 interprets the movement as down or right. If the 
movement is clockwise, the controller interprets the movement as up or left. 

[0026] The touchpad 1 02 in Figure IB has a hole 103 in its center. In other 
embodiments, the touchpad 102 or other interface element does not have a hole. A 
bushing 104 is inserted into the hole 103 from the underside of the touchpad 102 as 
shown. The bushing 104 both supports and physically isolates the touchpad 102 from the 
other elements of the user interface 100, allowing the touchpad 102 to rotate about a 
central axis. The nature of the bushing 104 shown in Figure IB does not allow the 
touchpad to move up and down or side to side. Other embodiments allow such 
movements. 

[0027] The bushing 1 04 or other support preferably offers stability combined with 
low friction. In the embodiment shown in Figure IB, the bushing 104 is constructed 
from a low-friction plastic material. In other embodiments, the bushing 104 is 
constructed from metal or another suitable material. The placement of the bushing 104 
allows the touchpad to rotate in response to an actuator. 
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[0028] In other embodiments, the bushing 1 04 may be replaced with linkages or 
alternative pivots to allow the touchpad 102 to react the forces. An embodiment may 
utilize roller elements or balls to support the magnets against the fixed steel to maintain 
the optimal gap. In one embodiment, the touchpad 102 does not include a center hole. 
Such an embodiment may eliminate physical switches and implement buttons, including 
the center button, as virtual buttons. The touchpad 102 may also include additional 
distinct regions anywhere on its surface to represent buttons. By utilizing a rotational 
movement for a circular touchpad, the embodiment shown in Figure IB provides a 
natural-feeling sensation to a user. The sensation feels the same everywhere on the 
touchpad in the embodiment shown; in other embodiments, the construction of 
waveforms and other means may be employed to vary the sensation at different locations 
on the touchpad. 

[0029J Preferably the rotation of the touchpad 1 02 is limited to optimize the haptic 
cue. A user experiences a haptic cue optimally when the user is unaware of the actual 
movement of the user interface and instead feels only the cue itself. In one embodiment, 

pin (not shown) is attached to the touchpad 102. The pin sits in a slot (not shown) in 
the button carrier 106. The slot is parallel to the touchpad 102 so that when the touchpad 
102 rotates, the pin travels within the slot. In a preferred embodiment, the slot has a 
length of 2 millimeters. An approximately 2-millimeter stroke is preferred for providing 
a haptic cue without a user realizing that the touchpad 102 is rotating. This small 
displacement occurs in response to an actuator and the rotation is felt by the user as a real 
time haptic cue synchronized with the user interface display events. 
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[0030] Self-centering of the touchpad 102 is also preferable in an embodiment of the 
present invention. The actuator 1 1 1 shown provides self-centering in the form of a high 
reluctance torque, which is also referred to as "cogging." The natural tendency of the 
actuator 1 1 1 to spring center itself keeps the system near equilibrium and prevents the 
finger dragging force from rotating the touchpad 102 to one limit stop where only half of 
a waveform defining a haptic cue would be felt. Other embodiments may realize such 
spring centering with the addition of springs; however, the addition of springs would add 
additional resistance that would have to be overcome by the output force of the actuator 
111. 

[003 1 ] The bushing 1 04 also has an opening in the middle. The opening allows the 
bushing to be situated around a central button 106 of a button carrier 108. The button 
carrier 108 of the embodiment shown supports conventional buttons. In other 
embodiments, the button carrier 108 may be constructed to accommodate other button 
types. A button cap 1 10 snaps onto the central button 108 and secures the bushing 104 
and the touchpad 102. 

[0032] As described above, the bushing 104 allows the touchpad 102 to rotate. An 
actuator in communication with the touchpad 102 provides force to rotate the touchpad 
104 and produce a haptic effect. The actuator in the embodiment shown in Figure IB is a 
small, moving magnet actuator 1 1 1. The actuator 1 1 1 uses a radial geometry and 
rotational support to create magnetic attractive forces. The magnetic assembly and poles 
are curved. Such a configuration creates a constant nominal magnetic gap and produces a 
rotational torque. 



11 



Express Mail Label No. EV 315 187 795 US 
Attorney Docket No. IMM 1 5 1 
PATENT 



[00331 Tn such an embodiment, the stationary steel may be formed into distinct 
shapes to fit in various locations in a preexisting device design without affecting the 
stationary steel's ability to create a magnetic field. Such an embodiment may include 
shapes and be implemented in various positions within a device. 
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[0034] The actuator includes a backing plate 1 12. In the embodiment shown, the 
backing plate 1 12 is made from steel. Attached to the backing plate 1 12 is a two-pole 
magnet 1 14. The two-pole magnet 1 14 may comprise a single, curved two-pole magnet 
or a series of smaller magnets arranged to form a two-pole magnet. However, the two- 
pole magnet 1 14, may be created using a series of smaller magnets as is shown in Figure 
IB. In the embodiment shown, the two-pole magnet 1 14 comprises six small magnets, 
three north and three south. The steel backing plate 1 12 and the magnet 1 14 rotate with 
the touchpad 102 and are therefore supported indirectly by the bushing 104. 

[0035] In the embodiment shown in Figure IB, a magnetic field causes the touchpad 
102, steel backing plate 1 12, and magnet 1 14 to rotate. An E-Core 1 16 creates the 
magnetic field. The E-Core 116 shown is a ferromagnetic material created to roughly 
approximate the shape of the letter E. The central pole of the E-Core 1 16 is wrapped 
with a coil 118. When current goes through the coil 1 1 8 it influences the magnetic field 
that is coupled between the magnets in the two-pole magnet 1 14. And the current that 
goes through that coil 1 1 8 produces forces on the magnet 1 14 and results in a torque 
about the center of rotation of the circular touchpad 102. 

[0036] The E-Core 1 1 6 is mounted in the embodiment such that the poles of the E- 
Core maintain an optimal gap from the magnet 1 14 mounted on the backing 116. 

12 
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Therefore, when the E-Core 116 emits a magnetic field, the magnet 1 14 moves. And 
since the magnet is attached to the backing plate 1 12, which is attached to the touchpad 
102, the touchpad 102 moves as well. The structure is arranged such that the magnet 
114, and thus the touchpad 102, moves rotationally when the actuator 1 1 1 is activated. A 
controller (not shown) controls the magnetic field precisely so that the movement 
approximates a waveform, which is interpreted by the user of the touchpad 102 as a 
specific vibrotactile effect. 

[0037] Figure 2 is a non-exploded, bottom view of the user interface 1 00 shown in 
Figures 1 A and IB. The touchpad 102 is mounted on a bushing 104. The bushing 104 is 
mounted in the center of the button carrier 106. Figure 2 illustrates the spatial 
relationship between the backing steel 112 and attached two-pole magnet 114 and the 
poles of the E-Core 116. Since the poles of the E-Core are curved, a constant, optimal 
gap is maintained between the poles and the magnet 1 14. Figure 2 also illustrates four 
conventional buttons 202a-d located on the button carrier 106 and visible on the interface 
100 of the personal MP3 player shown in Figure IB. Also shown is the control cable 204 
that carries signals from the touchpad 102 to a processor (not shown). 

[0038] Figure 3 is a cross sectional view of the user interface 100 depicted in Figures 
IB and 2. Figure 3 further illustrates the physical relationship between the touchpad 102, 
the bushing 104, and the central button in the button carrier 108. Figure 3 also illustrates 
the physical relationship between the touchpad 102 and the actuator structure 111. 

[0039] Figure 4 is a top view of the user interface 1 00 shown in Figures 1 -3 . Figure 4 
illustrates the relationship between the various elements of an embodiment as perceived 
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by the user. In addition, in the embodiment shown, the E-Core 1 16 is attached to the 
corner of a printed circuit board (PCB) 402. The PCB 402 provides a solid mounting 
point for the E-Core 1 16. In other embodiments, the E-Core 1 16 may comprise an 
elongated E-shaped conductive material attached to another element in a device. As is 
described above, the material may be formed in many different shapes and lengths and 
placed anywhere within a particular device. The ability to conform the E-Core 1 16 to a 
shape necessary for packaging within an existing design provides great flexibility in 
implementing an embodiment of the present invention. This flexibility also allows an 
embodiment to be implemented with minimal impact on the pre-existing components 
within a device. Therefore, embodiments of the present invention may be implemented 
in the design of new devices or created as replacement kits for existing devices. 
Regardless of the shape utilized, the various embodiments of the E-Core 1 16 maintain a 
consistent gap between the magnet 1 14 and the poles of the E-Core 116 preferably. 

[00401 An embodiment of the present invention is particularly advantageous for 
providing haptic feedback in small devices, such as a personal digital assistant (PDA), 
cell phone, or MP3 player. Such devices conventionally include circular touchpads such 
as the touchpad 102 shown in Figures 1 A and IB or may include rotary dials or other 
similar user interface elements (embodiments of the present invention may be employed 
to provide haptic feedback to all such elements). The user of such a device utilizes the 
circular touchpad to navigate the menus 404 of the device. An embodiment of the 
present invention may be implemented in the device to provide haptic cues in response to 
user interface events, such as the change of a displayed cursor position or reaching the 
end of a list of items in a menu. 

14 
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[0041] Such a device may be created by adding a processor (not shown) and 
firmware to the embodiment shown in Figures 1-4 that is capable of receiving real-time, 
serial data from the device, processing the events and, in response, generating a signal. 
Alternatively, the device's primary processor may perform the functions required for an 
embodiment. The processor receives input and generates signals for the coil. In one 
embodiment, an amplifier (not shown) accepts the signal generated by the processor and 
supplies a high current signal to the E-Core 116. The current drives the coil 118; whose 
field acts in a magnetic circuit arranged in such a way that it produces a torque on the 
circular touchpad 102. 

[0042] The amplifier may be, for example, a DC or AC-coupled audio amplifiers. 
However, an AC-coupled audio amplifier may be preferable in many environments 
because of the relatively low cost, the availability of off-the-shelf components, and the 
ability to use a larger range of coil resistance than is practical for a DC-coupled amplifier. 
Also, the AC-coupled amplifier may be bypassed with large capacitance values to permit 
very high peak root-mean-square (RMS) currents while preventing accidental 
overheating. 

[0043] Various other embodiments of the present invention are capable of providing 
force feedback in rotational interface elements. These embodiments are capable of 
implementation in a small device, such as an MP3 player, a personal digital assistant 
(PDA), or a digital camera. The actuator in small devices is preferably 6mm or less in 
height and requires low RMS current on the order of 1 50-200mA. 
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[0044] Figure 5 is a top view of one alternate embodiment of the present invention in 
which an eccentric rotating mass motor providing feedback for a rotational touchpad. In 
the embodiment shown, a touchpad 500 rotates around a central axis 502. The touchpad 
500 is attached to a small motor 504 near the outer edge of the touchpad 500. A fastener, 
such as a screw, attaches the motor 504 and touchpad 500. The motor 504 shown in 
Figure 5 is commonly referred to as a coin style vibration motor. The motor 504 is of a 
type conventionally used in pagers to provide a vibration and is particularly advantageous 
for use in a small device because of its small profile and ability to fit inside of a small 
case. The motor 504 shown in Figure 5 operates on 3.3 volts, are approximately 2 
centimeters in diameter and 5 millimeters in height. 

[0045] The motor 504 includes an eccentric mass. The eccentric mass and all of the 
windings and additional components of the motor operate within that volume. The motor 
504 naturally produces a vibration of approximately 80hz. However, in the embodiment 
shown, the motor is driven bi-directionally to create frequencies greater than 80Hz. 

[0046] The motor 504 is attached to the underside of the touchpad 500 and rotates in 
the same plane as the touchpad 500 rotates. The motor rotation is limited. Two rubber 
end-stops 606a, b limit the rotation of the motor 504. Preferably, the rotation of the 
touchpad 500 is limited. In the embodiment shown, since the rotation of the motor 504 is 
limited and the motor 504 is attached to the touchpad 500, the rotation of the touchpad 
500 is limited as well. 

[0047] The embodiment shown in Figure 5 is extremely strong when operating in DC 
mode and is able to vibrate the touchpad 500 quite violently, producing a distinct, strong 
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"pop" sensation. Careful adjustment of the effect length results in an extremely 
convincing effect. Such an embodiment may be used to perform a standard vibration 
function along with creating a vibrotactile-effect. The ability to combine multiple 
functions in a single device is a particularly advantageous feature of this embodiment. 

[0048] The use of the embodiment shown in Figure 5 may provide poor high- 
frequency response because during experimentation at frequencies above 15Hz, the 
motor no longer rotates in ERM mode, and force began to drop off. By 100Hz, the forces 
are difficult to sense. Also, the motor 504 shown required 70ms to achieve full ERM 
forces. Also, the embodiment shown produced only a limited number of haptic effects. 
These attributes may be eliminated or reduced by employing a different type of, or more 
advanced, motor. 

[0049] The embodiment shown in Figure 5 may be modified in various ways to affect 
its ability to provide haptic feedback. For example, the coin-style vibration motor may 
include a spring mount attached between the motor 504 and the touchpad, converting the 
motor 504 into a highly-eccentric rotating mass (HERM). Also reducing the mass of the 
touchpad 500 and decreasing any vibration present in the central axis 502 may enhance 
the effect of the motor vibration. 

[0050] Figure 6 is a top view of yet another embodiment of the present invention. 
The embodiment shown in Figure 6 utilizes a belt-drive system to provide haptic effects. 
Figure 7 is a side view of the embodiment shown in Figure 6. In the embodiment shown, 
a touchpad 600 rotates around a central axis 602. A small DC motor 604 turns a capstan 
or pinion 606. A belt 608 wraps once around the capstan, twists 90° and then wraps 

17 



Express Mail Label No. EV 315 187 795 US 
Attorney Docket No. IMM 1 5 1 
PATENT 

around the touchpad 600. The belt 608 sits in a pulley groove machined into the outside 
edge of the touchpad 600. In operation, the motor 604 is driven back and forth to provide 
haptic sensations in the touchpad 600. An embodiment, such as the one shown in Figures 
6 and 7, is capable of providing feedback to a touchpad over either a limited range of 
rotation, or over a large range of rotation. However, in a touchpad that rotates over a 
large range, such as 360°, the motor, capstan, and belt still provide a vibrotactile effect as 
opposed to a kinesthetic effect. 

[0051] The embodiment shown in Figures 6 and 7 provides high torque amplification. 
For example when a small capstan 606 with a 6 mm diameter combines with a large 
touchpad 600 with a 52 mm diameter, the embodiment can provide an 8.7:1 
amplification, resulting in a measured peak torque at the touchpad 600 of 2.2mNm. This 
amplification allows a relatively weak motor to product a strong enough vibration to 
deliver a convincing vibrotactile force. 

[0052] An embodiment such as the one shown in Figures 6 and 7 provides a compact 
assembly. The distance between the center of rotation of the touchpad 600 and motor 
604 is determined by the o-ring diameter. Therefore, a smaller diameter o-ring provides 
an even more compact implementation. The embodiment shown produces sensations up 
to approximately 200Hz. Although the belt 608 shown in Figures 6 and 7 is a rubber 
belt, the belt 608 may comprise a variety of materials, including steel cable, wire, and 
string. The rubber belt is advantageous because is it self-tightening and therefore 
requires no external spring or large tension in the cable. Additionally, since the rubber 
belt 608 is not fixedly attached to the touchpad 102, the belt 608 is never fully grounded, 



18 



Express Mail Label No. EV 315 187 795 US 
Attorney Docket No. IMM1 5 1 
PATENT 

i.e., the belt 608 continues to move around the touchpad 102 when the touchpad 102 
stops moving. Accordingly, even if the user grounds touchpad 600, the motor continues 
to rotate and add energy to the system, i.e., spin the belt 608. If the motor 604 were to 
stall, the power consumption would increase. 

[0053] Various modifications of the embodiment shown in Figures 6 and 7 may be 
implemented. For example, a stiffer belt material would reduce flex and stretch and 
thereby increase the efficiency of energy transmission. Also, the belt 608 may wrap 
around the capstan 606 multiple time, eliminating the potential for belt slippage and 
movement across the capstan 606. In addition, adhering the belt 608 to the touchpad 600 
would reduce the potential for slipping and the corresponding energy loss. In other 
embodiments, a smaller motor 606 reduces the size of the device. 

[0054] Figure 8 illustrates another embodiment of the present invention. Like the 
embodiment shown in Figures 6 and 7, the embodiment shown in Figure 8 includes a 
small DC motor 804 with a pinion 806. The pinion 806 is attached to a brass flexure 808. 
The brass flexure 808 is bent in two places 810 to form hinges. The flexure 808 is also 
attached to the touchpad 800, which again rotates around a central axis 802. As the 
motor 804 rotates back and forth, it provides haptic feedback to the touchpad 800. 

[0055] The bend 810 in the brass flexure 808 provides a degree of freedom necessary 
to rotate the touchpad 800 from side-to-side using a pinion 806 rotating up and down. A 
metal flexure is preferable to a plastic flexure in a small device. The range of rotation of 
the touchpad 800 is preferably limited. 
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[0056] The embodiment shown in Figure 8 provides high torque amplification with 
no backlash over a limited rotation angle. The combination of the small pinion 806 and 
the large touchpad provides the amplification. For example, the pinion pictured has a 
6mm diameter and the touchpad 800 has a 40mm diameter, providing a 6.7:1 
amplification, allowing a relatively weak motor to deliver convincing vibrotactile forces. 
The device shown provides a measured peak torque 1.8mNm between approximately 0 
and 200+ Hz. Although a metal flexure is preferred, other materials may be used to 
create the flexure, such a polypropylene or spring steel. One advantage of spring steel is 
Us self-centering properties, i.e., the spring hinge finds a neutral position. As described 
above, a smaller motor decreases the size of an embodiment. Embodiments may also use 
a single-piece, molded hinge. The embodiment shown in Figure 8 is preferably a large 
diameter touchpad 102. The touchpad 102 is preferably not a continuous turn device 

[0057] An embodiment of the present invention includes processing logic. The 
processing logic may be in the form on computer program code stored in a computer- 
readable-medium, such as a programmable read-only memory (ROM). Processing logic 
so stored is often referred to as firmware. Firmware according to the present invention 
accepts parameters regarding the context in which the user is operating as well as user 
interface parameters to determine the type of haptic effect to create. The firmware may 
perform other tasks as well. 

[0058] Figures 9A and 9B are block diagram, illustrating communications occurring 
between various elements in embodiments of the present invention. In the embodiment 
shown in Figure 9A, a touchpad 900 receives signals from buttons 902. The touchpad 
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900 also communicates with a device processor 904. The device processor 904 receives 
the interface inputs and, using software and/or firmware, determines the appropriate 
signals to transmit to the liquid crystal display (LCD) 906. In an embodiment of the 
present invention, the device processor 904 also sends serial signals to a haptics processor 
908. The haptics processor 908 utilizes firmware to compute forces and corresponding 
actuator commands. The haptics processor 908 communicates the resulting commands to 
a haptics actuator 910. In the alternative embodiment shown in Figure 9B, the touchpad 
900 communicates signals to the haptics processor 908, which communicates original or 
modified serial or PS/2 signals to the device processor 904. 

[0059] Figures 9C and 9D are timing diagrams, illustrating two methods of passing 
signals between the elements shown in Figure 9A in an embodiment of the present 
invention. In the embodiment shown in Figure 9C, the haptics processing is performed 
by the haptics processor based on input from the device processor, which includes list 
information and cursor events. Such an embodiment requires few changes to a device; 
the device must simply support a serial output interface. Such an interface supports 
fixed-size detents, end-of-list functionality and hot-key functionality. 

[0060] Referring to Figure 9C, when a button 902, such as the buttons shown in the 
personal MP 3 player interface of Figure IB, receives input, such as when a user pushes 
the button 902. In response, the button sends a transistor-transistor logic (TTL) signal to 
the touchpad 102, 912. The touchpad 102 interprets this information as well as any user 
input directly on the touchpad 102 and sends a serial or PS/2 signal to the device 
processor 904, 914. In response, the device processor 904 sends the appropriate signals 
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to the LCD 906 to modify the display viewed by the user 916. The device processor 904 
also sends a serial packet to the haptics processor 908, 918. The serial packet may 
include, for example, a start character, a packet identifier, the length of the currently 
displayed list, the visible length of the list, the list offset, the visible list offset, the haptic 
cue, and a checksum. In one embodiment, the haptics cue includes identifiers for new 
list, interface buttons, parent, and low battery. 

[0061 ] The embodiment shown in Figure 9D includes the same basic components; 
however, the message flow between the various elements is somewhat different. In this 
embodiment, the haptics processor intercepts the touchpad 102 radial position signal 914 
and includes logic to process the list information accordingly. In such an embodiment, a 
message 922 passes from the haptics processor to the device processor that includes the 
touchpad signal. As with the previously illustrated embodiment, such an embodiment 
requires few changes to the subject device. The embodiment can create various effects, 
including variable-size detents, end-of-list, hot keys, rate control, virtual buttons, long 
lists, and breakouts. Since the haptics processor 908 must generate the touchpad signal 
to send to the device processor 904, the haptics processor may need to emulate the 
touchpad's native protocol. 

[0062] Various types of effects may be created to effectively provide haptic cues in 
an embodiment of the present invention. One embodiment features a "tink" effect on 
detent change; a "tonk" effect on screen scroll; a "thunk" effect on last item in list; a 
"pang-ping" effect on new list, a falling frequency on low battery or power down; a "tick- 
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tick" indication when cursor lands on a parent; and a "bleep" effect when a button is 
pressed. 

[0063] Figure 1 0 is a flowchart, illustrating the flow of information between various 
modules of the firmware in an embodiment of the present invention. The firmware 
comprises software that is stored in read only memory in a device, such as in an 
electrically erasable programmable ROM (EEPROM). The firmware is designed as a 
series of interrelated modules. By utilizing modules, the ease of maintenance and 
portability of the firmware are enhanced. In the embodiment shown, a PC 1002 or 
Device 1004 serial port utilizes a serial link to provide information to a serial module 
1008. Either device can set force effects in the firmware. The serial module implements 
the serial communications link using hardware-dependent calls. The main task is to send 
and receive characters. The serial communication module 1010 implements the serial 
communication protocol to code-decode packets that will be sent or received. The device 
manager module 1012 determines which module is responsible for processing an 
incoming packet. The types of incoming packet may include list effects, basic effect, or a 
packet containing position only. If the device manager 1012 detects an effect packet, the 
list manager module 1016 handles the packet. The list manager module 1016 interprets 
the list parameters and implements the required effect. If the device manager 1012 
detects a basic effect, the effect manager 1014 handles the effect. As indicated in Figure 
10, the list manager 1016 may determine that a basic effect is required. 

[0064] The effect generator module 1020 computes the effect. The force module 
1022 performs the interface functionality between the computed force value and the 
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micro-controller peripheral that writes the computed force to the actuator and associated 
electronics. The force module 1022 supports an enabling line, a direction line and a pulse 
width modulation (PWM) line. The PWM module 1024 is a hardware-dependent module 
that writes the computed force values to the actuator and/or electronics. The firmware 
controls the instantaneous current through the coil by modulating the duty cycle of a high 
frequency pulse train, typically 10 - 40KHz. The module 1024 supports each of the lines 
specified in the force module 1022 even if a corresponding action is not available. 
Supporting the additional lines provides flexibility and portability. 

[0065] Figures 1 1 A and 1 1 B illustrate two embodiments of the process for 
interpreting list and haptic cue parameters in embodiments of the present invention. The 
process illustrated in Figure 1 1 A is a synchronous process; the process illustrated in 
Figure 1 IB is asynchronous. An example helps to illustrate the difference between the 
two approaches. In the exemplary case, the firmware compares two consecutive packets 
and determines that (i) the cursor jumped 3 cells and (ii) the battery is low. In a 
synchronous embodiment, the processor processes the list effects before disabling the 
forces. In other words, the device expends current to generate forces notwithstanding the 
low power level of the battery. If, instead, the forces are merely set and then played after 
it is determined whether the battery level is low, asynchronous embodiment, power 
output is minimized according to battery state. 

[0066] In the process illustrated in Figure 1 1 A, the firmware gets data from a 
received packet 1 102. The firmware utilizes the data to compute a position offset 1 104. 
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The firmware utilizes this information for both list processing 1106 and haptic processing 
1 108 before ending the process 1110. 

[0067] If the data indicates that the user has entered a new list 1112, firmware causes 
a new list effect to be played 1114. Playing the effect immediately upon determining the 
state of the interface is synchronous processing. If the data does not indicate that a new 
list has been entered, the firmware determines whether the position has changed, i.e., is 
the position delta greater than zero 1 1 16. If so, the firmware determines whether the end- 
of-list has been reached 1118. If yes, the firmware causes the end list effect to be played 
1 120. If the end-of-list has not been reached, the firmware determines whether a scroll 
event has occurred 1 124. If so, the firmware causes a scroll effect to be played 1 126, and 
if not, a detent effect to be played 1 128. When the firmware completes the list processing 
1 106, it begins the haptic processing 1 108. 

[0068] The firmware first checks for a low battery state 1 1 30. If the battery is low, 
the firmware causes the low battery effect to be played 1 132 and ends the process 1110. 
If not, the firmware determines whether a parent effect should be played 1 134. If so, the 
firmware causes a parent effect to be played 1136 and ends the process 1 1 10. If not, the 
firmware determines whether a button effect should be played 1 138. If so, the firmware 
causes a button effect to be played 1 140 and ends the process 1110. If no button effect is 
to be played, the firmware ends the process 1110. 

[0069] The asynchronous process illustrated in Figure 1 IB is almost identical except 
for the addition of a couple of processes. Also, rather than causing effects to be played 
immediately, in the embodiment shown in Figure 1 1 A, the firmware sets the event to be 
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played subsequently. The first step in the list manager process 1 106 determines whether 
an effect should be set 1 1 1 1 . If so, list processing occurs as illustrated in Figure 1 1 A. If 
the effect is not to be set, the firmware causes a low battery effect and disables forces 
1132. The second additional process occurs during the effect process 1 1 08. If an effect 
is set in the list process 106, the firmware causes the effect to be played in step 1133, 
after determining the battery state in step 1 130. 

[0070] To effectively perform the processing logic illustrated in Figures 1 1 A and 
1 IB, position latency should preferably be limited to 15ms, which corresponds to a 
screen refresh rate of 60Hz. Packet and list parameter latency, i.e., how often list 
parameters are changed, are also preferably 15 ms. This period of latency corresponds to 
how often changes requested by the user can be reflected on the display. The firmware 
may execute the processing logic in response to a number of events, including effect 
completion, a timer, and preferably upon packet reception. Various embodiments may 
perform additional processing, including comparing two consecutive packets to detect 
changes, allowing multiple effects at one time, and receiving a persistent low battery 
signal. 

[0071] The foregoing description of the preferred embodiments of the invention has 
been presented only for the purpose of illustration and description and is not intended to 
be exhaustive or to limit the invention to the precise forms disclosed. Numerous 
modifications and adaptations thereof will be apparent to those skilled in the art without 
departing from the spirit and scope of the present invention. 
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